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Time-inhomogeneous controlled diffusion processes in both cylin¬ 
drical and noncylindrical domains are considered. Bellman’s principle 
and its applications to proving the continuity of value functions are 
investigated. 


The first part of this article is devoted to quite an old subject in the 
theory of controlled diffusion processes, namely deriving Bellman’s principle 
(also called the principle of optimality) for processes controlled up to the 
first exit time from bounded domains. This principle plays a major role in 
many aspects of the theory of controlled diffusion processes. The necessity of 
proving it and deriving from it some continuity properties of value functions 
came to light while investigating the rate of convergence of finite-difference 
approximations for Bellman’s equations. In this connection, we point out 
that our main results are Theorems 2.10, 2.13 and 2.17 in the second part 
of the paper. Theorem 2.17 is one of the main ingredients in [3], where 
we proved a sharp result that the rate of convergence of finite-difference 
approximations for Bellman’s equations in bounded domains is not less than 
with h being the mesh size. Theorem 2.17 is similar to Theorem 2.1 
of [8] and is nontrivial even if we consider a single diffusion process without 
any control. In that case, it yields the rate of convergence without much 
work (see, e.g.. Corollary 1.10 of [8]). 

Our main results depend heavily on the validity of Bellman’s principle. 
Bellman’s principle has been derived in different settings in many papers and 
books. We refer the reader to [1, 2, 4, 5, 6, 10] and the references therein. 
Probably the article closest to the subject of the present one is [6], where 
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Bellman’s principle is derived under very general conditions allowing un¬ 
bounded domains and the coefficients of the controlled processes, but only 
for the problem of optimal stopping of controlled processes. Later on, these 
results were used to obtain sharp results concerning when the value func¬ 
tions for time-homogeneous processes satisfy the corresponding Bellman’s 
equations. Another result, which is also very close to the results presented 
in the first part of this paper, is Theorem 2.1 in Chapter V of [4]. However, 
there are gaps in the original proof of the theorem (the corrected version is 
to appear in the forthcoming second edition of [4]) and the conditions under 
which it is stated are somewhat different from those we require for some ap¬ 
plications we wish to consider. It is worth noting that in [4], the controlled 
process is considered up to the first exit time from the closure of a domain, 
so that if we have two domains with the same closure, the corresponding 
value functions will coincide. In contrast, we consider exit times from a do¬ 
main as is usually done in the theory of Markov processes. One of major 
technical differences between these two settings is that our exit times are 
lower semicontinuous and the exit times from [4] are upper semicontinuous. 

The approach in [4] originated from [11], where the reader can also find 
many useful results concerning the continuity of value functions. 

In Section 1 we prove Bellman’s principle in a setting more general than 
that of Theorem 2.1 in Chapter V of [4] (see Remark 1.14). Several examples 
show that under the assumptions in Section 1 , value functions can be discon¬ 
tinuous even inside the domains. With additional assumptions, in Section 2, 
we prove the Lipschitz continuity of value functions in space variables and 
Holder-1/2 continuity in the time variable, which is one of the main moti¬ 
vations of this paper. In Remark 2.14, we also present our understanding 
as to how the statement of Theorem 2.1 in Chapter V of [4] regarding the 
continuity of value functions can be corrected. Finally, we derive in Corol¬ 
laries 1.3 and 2.12 an inequality which we use to prove Theorem 2.17. As we 
have mentioned above, the last theorem plays a major role in investigating 
the rate of convergence of numerical approximations for Bellman’s equations 
in domains. 

1. Bellman’s principle. Let A be a separable metric space and let A{n) 
be fixed subsets of A, n = 1,2,..., such that A = IJ^ A(n), A(n) C A(n -|- 1). 
Let be a complete probability space and {Pt'P > 0} an increasing 

filtration of cr-algebras .T) C .F which are complete with respect to J-, P. Let 
{wt,iPt]t > 0) be a di-dimensional Wiener process on {Q,P,P). 

Suppose that the following have been defined for a G A and {t, x) G M x 
a d X di matrix a d-dimensional vector b^{t,x) and real numbers 

c"(t,x), f°‘{t,x) and g{t,x). We assume that for every n > 1, on A(n) x 
the functions a,b,c and / are Borel, bounded, continuous in {a,x) 
and continuous in x uniformly with respect to a for each t G M. Moreover, 
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for every n > 1, on A{n) x let a and b satisfy a Lipschitz condition in 

X with constant not depending on (a,t) and let g be lower semicontinuous 
and bounded in 

By 2t(n), we denote the set of all functions ar{uj) on O x [0,oo) which are 
^r-adapted and measurable in {u},r) with values in A{n). Let 2l = lJ„2l(n) 
and let 971 be the set of all bounded stopping times (relative to {.?>}). 

For a G 21 and {t, x) G we consider the ltd equation 


ps ps 

( 1 . 1 ) Xs = x+ / a°'^{t + r,Xr)dwr+ / b°‘^{t + r,Xr)dr. 

Jo Jo 

The solution of this equation is known to exist and to be unique. We denote 
this solution by following the abbreviated notation adopted in [5]. 

For any s > 0, we set 




■■ rc“’'(t + r,x“’‘’^)dr. 

30 


Let Q be a bounded domain in = M x and let r = be the first 
exit time of {t + from Q: 

= inf{s > 0: (t + s, ^ Q}. 


Observe that since Q is bounded, is a bounded stopping time. 

Define the parabolic boundary d'Q of Q as the set of all points {t,x) 
on dQ for each of which there exists a curve (s, t — e < s <t, such that 
e > 0, {t,yt) = {t,x), Us is a continuous function and {s,ys) & Q, t — e < s <t. 
Obviously, if {t,x) G Q, then at s = the point (t-|-s,x“’h^) lies on d'Q. 

Set 


v°‘{t^x) = Ef^ [ + s,Xs)e ds + g{t + T,Xr)e 

’ Uo 


V = sup , 
aea 


where we use common abbreviated notation, according to which we put the 
indices a, t, x beside the expectation sign instead of explicitly exhibiting 
them inside the expectation sign for every object that can carry all or part 
of them. For instance. 


Et,x9it + r, Xr)e = Eg{t + 


a,t,x \ ( OL.t.x \ 


It is worth noting that = 0 if {t,x) ^ Q. Therefore, v = g in . 

The above assumptions and notation will apply throughout the paper. 
Additional assumptions will be introduced for each particular result. 

Observe that since Q is bounded, v > —Ai, where is a constant, and 
the case u = oo in Q is not excluded. 

The following version of Bellman’s principle is the first main result of this 
section. 
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Theorem 1.1. Assume that g^O and that there is an a ^ A such that 
/—> 0 on Q. Then: 

(i) the funetion v is Borel measurable, nonnegative and, moreover, it is 
lower continuous in Q, that is, 

v{t,x)= liminf v{s,y) V(t,x)e(5; 

(ii) we have 

(1.2) v{t,x) = sup f f°‘‘‘{t + s,Xs)e~‘^‘’ds + v{t +'y,x^)e~'^~' 

aem ’ Uo 

whenever {t, x) £ Q and for any a G 21, we are given a stopping time 7" < 
^a,t,x (1.2) the superscript a of 7“ is dropped in aceordance with the 
above stipulation]. 

Proof. For any 7 G 911, we set 

V^’'^{t, x) = r /"»{t + s, x,)e-^^ ds, 

’ Jo 

w{t,x) = sup sup {t, x). 

aGS2t7erot 

It is known from [6] (see Theorems 1.1, 2.4 and Lemma 2.2 therein) that 
under the conditions of the theorem, u; > 0, the function w is Borel, it is 
also lower continuous in Q, we have 

(1.3) w{t, x) = v{t, x) 
on Q and the process 

rsAr 

p^ = p<fJ’^ = w{t + sAT,XsAr)e~‘^’’''^+ / f'^^{t + r,xr)e-^^dr 

Jo 

is a supermartingale on [0,oo) for any a G 21. Therefore, we have 

(1-4) v{t, x) = Ef,^po > Ef‘^^p^ > Ef‘^^p^. 

After taking supremum over a G 21 in (1.4), we obtain 

(1.5) v{t,x) = supSi^^po > supEf^„^p,y > supEf,^pr. 

oe2i oe2i aea 

Since the rightmost term in (1.5) equals v{t,x) by definition, all the inequal¬ 
ities in (1.5) are equalities. To complete the proof of (1.2), it only remains 
to observe that its right-hand side equals sup^, □ 

Remark 1.2. Since u = 0 on dQ (even in Q‘^) and u > 0 in Q, the lower 
continuity of v holds on Q, provided that dQ has no isolated points, because 
V is continuous along dQ, being identically zero there. 
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Set 

d d 

~ ~ 5?’ ~ ^i^ji ® = (1/2)cj(T , 

L“ = L^{t,x) = {a^y^{t,x)Dij + {h^)\t,x)Di - c“(t,x). 

As a corollary of Theorem 7.4 of [7] (or of the corresponding results in [5]) 
and Theorem 1.1, we have the following result. We remind the reader that 
Lipschitz continuous functions have bounded first-order generalized deriva¬ 
tives. 


Corollary 1.3. In addition to the assumptions of Theorem 1.1, sup¬ 
pose that V is bounded in an open set Q' C Q and that for any a G A, the 
generalized function 

(1.6) EOy 

hj 

is a locally integrahle function on Q'. Then 


(1.7) Dtv + L^v + f^ <0 

in Q' in the sense of generalized functions, that is, for any nonnegative 

x^c^iQ'). 


where 


[ v{-D, 

JQ' 


't + L^*)xdtdx+ / f^xdtdx<0. 


'Q' 


:= {a-yW,, - (6“)*A + 2[A(a“)*^]A + A,(a“)*^' - A(fe“)* - C 


Example 1.4. Generally, in the situation of Theorem 1.1, the function 
V need not be continuous in Q, even if / is bounded. For instance, take 
d = 2 and consider the following (uncontrolled deterministic) process in = 
{{x,y):x,yGM}: 

(1.8) dxt = dt, dyt = 0. 

Let c = 0, / = 1 and Q = (—1,4) x (A \ Bi), where A is the open ball of 
radius r centered at the origin. As is easily seen, v{0,x,y) is discontinuous 
along the lines y = ±1, x G [—\/3,0]. 


To obtain a generalization of Theorem 1.1 for g ^0, we need one more 
assumption on Q. 
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Assumption 1.5. There exists a function V’ G C{Q) such that the first 
derivatives of ij: with respect to (t, x) and the second derivatives with respect 
to X are continuous on Q, vanishes on the parabolic boundary d'Q of Q 
and for some a S A, 

(1.9) + inQ. 

Theorem 1.6. Suppose that Assumption 1.5 is satisfied. Then asser¬ 
tions (i) and (ii) of Theorem 1.1 hold true. In particular, if v is bounded 
in an open set Q' C Q and for any a € A, the generalized function (1.6) is 
a locally integrable function on Q', then (1.7) holds in Q' in the sense of 
generalized functions, as in Corollary 1.3. 


Proof. To exhibit the dependence of v and on g, write v = v[g\ and 
v°‘{g\. Since g is bounded and lower semicontinuous, there exists a sequence 
of smooth functions gn T 9- Also, notice that by the monotone convergence 
theorem, 

v^[g] = sup v^[gn], 

n 

implying that 


(1.10) v[g\ = supsupu"[ 5 n] = supsupu"[ 5 „] = supuf^n]- 

an n a n 

This shows how to obtain (1.2) for g from the same assertion for gn, so that in 
the proof of (1.2), we may assume that g' is a smooth function. Furthermore, 
since r = = 0 if {t, x) G dQ, we may assume that {t, x) G Q. 

Next, let be a positive real number to be chosen later. Owing to Ito’s 

formula and the facts that {t + r, G d'Q and = 0 on d'Q, we have 


v°‘{t, x) — g{t, x) + Nfi{t, x) 


( 1 . 11 ) 


= Ef 


]Sj\n + Dtg + L^^g 

Uo 


— NDtip — NL°‘‘’Tp){t -\- s,Xs)e ds 


Denote by /“ any continuous continuation of 

Dtg + L^g - NDtfi - 

outside Q. This is possible because by assumption, the derivatives of g and 
Tp involved above are continuous in Q. Then v°‘ — g Nfi is simply 
constructed from /“ + /" and g = 0. 

If (1.2) holds with 

v-g+Nfi, r^+r^ 
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in place of respectively, then by using Ito’s formula again, we ob¬ 

tain (1.2) in its original form. This enables us to assume that 5 = 0. Due 
to (1.9), we can choose N sufficiently large so that 

/- + /- = /- + Dtg + L^g - NDt^ - NL^ > 0 

in Q. Then (1.2) follows immediately from Theorem 1.1. This theorem also 
shows that v is lower continuous in Q, at least for smooth g. Then (1.10) 
implies that v is lower semicontinuous in Q in the general case. The fact 
that it is lower continuous follows from (1.2), as in the proof of Theorem 2.4 
of [6]. The theorem is thus proved. □ 

Next, we prove a similar result for processes in cylindrical domains. Let 
D be a bounded domain in and T G (0,oo) a fixed number. Usually, one 
is interested in processes (f-|-s, x"’*’^) not until but rather 

(1.12) (T-f) Ainf{s>0,x“’‘’"^^D}, 

which is the first exit time of {t -|- s,x“’h^) from (—oo,r) x D. These two 
exit times coincide if we take (0,T) x D as Q and t>0. However, if t = 0, 
then the former exit time is zero, since the starting point is already outside 
(0,T) X D. Psychologically, the value t = 0 looks important and, therefore, 
in order to allow the process {t + s,®"’*’*) to start at points (0,x) and yet 
have nontrivial objects to deal with, we set 

Q = {-l,T)xD. 

We impose an assumption slightly different from Assumption 1.5: 

Assumption 1.7. There exists a function i/l C C{Q) such that the first 
derivatives of ij: with respect to {t, x) and the second derivatives with respect 
to X are continuous on Q, tp >{) va. Q and vanishes on (—1,T) x dD. 
Condition (1.9) is also satished for an a G A. 

Observe that in Assumption 1.7, we do not require "0 to vanish on the 
whole parabolic boundary of Q. The reason is that if the derivatives of pj are 
continuous at points on {T} x dD and i/; = 0 on {T} x D and (0,r) x dD, 
then the left-hand side of (1.9) is zero on {T} x D and so this inequality 
cannot be satisfied. 

Remark 1.8. If in Assumption 1.7, inequality (1.9) holds only in (—1,T) x 
{D \ D'), where D' C D' C D, then one can modify in such a way that (1.9) 
holds in Q for the modification. To see this, it suffices to observe that 

(A + L“(t, x))[Pit, (A + L“)V^(t, x) - AiA(t, x) 

and to choose A large enough, which would work if > 0 in [—1,T] x D'. 
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It is also worth noting that Assumption 1.7 does not imply that dD 
is smooth. For instance, if D C M? = {{x,y) :x,y £ M} near the origin is 
described by y > 2\x\ and L" = A, then near the origin, one can take ^ = 
— 4x^. 

Theorem 1.9. Suppose that Assumption 1.7 is satisfied. Then asser¬ 
tions (i) and (ii) of Theorem 1.1 hold true. In partieular, if v is bounded 
in an open set Q' <ZQ and for any a £ A, the generalized function (1.6) is 
a locally integrable function on Q', then (1.7) holds in Q' in the sense of 
generalized functions, as in Corollary 1.3. 

Proof. As in the proof of Theorem 1.6, we reduce the general situation 
to the case where g is smooth and then, using Ito’s formula, to the case 
y = 0. Let g £ C'°°(M) be a function satisfying 

0 <? 7<1 inM, g=l in(—oo,—2], g = Q in[—l,+oo). 

For any e > 0 and a£ A, set 

fe{t^x) = f^{t,x)g{e~^{t-T)) 

and on Q, define vf and Ug with /“ in place of /“. From the definition of v, 
it is easy to see that ^ v uniformly on Q as e | 0. Therefore, it suffices to 
prove the theorem for functions / satisfying the additional assumption 

r = 0 on[T-e,T]x D 

for some e > 0 and any a £ A. 

Our goal is to apply Theorem 1.1. Denote 

fi = {T- t)fi/£. 

Obviously, ■0 > 0 in Q and it vanishes on d'Q. In (-l,T-e) X D, we have 
Dtfi + < £-\T - tfiDtfi + L^) < -1. 

Meanwhile, in [T — £,T) x D, we have 

Dtfi + < 0 . 

Therefore, we can choose N sufficiently large such that in Q, 

f^ - NDtfi - NLfifi > 0. 


By using Theorem 1.1 and the argument in the proof of Theorem 1.6, we 
complete the proof of the present theorem. □ 
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Remark 1.10. It is known (see, e.g., [5]) that the optimal stopping 
problem for controlled diffusion processes reduces to a problem without 
stopping, but with the data c“,/“ becoming unbounded in the variable a. 
Then the above results become applicable to the optimal stopping problem 
for controlled diffusion processes. This shows the usefulness of allowing our 
data to be unbounded in a. 

In the following example we present a situation in which 6“ and /" are 
unbounded: 


Example 1.11. Consider the so-called singular stochastic control prob¬ 
lem. Let xf be a process in defined by 


(1.13) 


= x-^wt-\- at, 


where wt is a d-dimensional Wiener process and a = at is a d-dimensional 
control process such that for any t>0, at is d^i-measurable. Moreover, we 
will allow any such continuous process for which 


\a\t Var[o,t]Q: 


:= sup 


< oo 



- at^\■.n = 1,2,<ti <■■■ <tn <t 


that is, we allow processes of locally bounded total variation. Fix a smooth 
bounded domain D C a lower semicontinuous bounded function g = 
g{t,x) on M X and a bounded continuous function / on W^. 


Assume that for t <T, we need to investigate 

v{t,x) = sup E< e~'^g{tT,Xr )/ e~^f{xs)ds— / e 
o I Jo Jo 


' d|a| 


where r is the minimum of the first exit time of Xt from D and T — t. 

The fact that we restrict ourselves to continuous at allows us to use 
smooth approximations of a and to do this in such a way that the exit 
points for the original process and its approximations are close. Obviously, 
one can approximate process (1.13) by processes of the form 

rt 

(1.14) x^ = x + wt + / (3sds, 


where /3 G 21 = lj„2l(n) and 2t(n) is dehned as the set of jointly measurable 
d^t-adapted processes with values in A{n) = {/3 G : |/3| < n}. It is also clear 
that 

v{t,x) = supEl^{e~'"g{t + T,Xr)+ [ e~‘'{f{xs) - \fJs\) ds 
/3e2l I Jo 
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Observe that due to the boundedness and smoothness of D, there is a 
smooth function ijj = 'tp{x) such that A'tp = —2 in D and ^ = 0 on dD. It 
follows that Assumption 1.7 is satished with a = 0. Therefore, Bellman’s 
principle is applicable in this situation. 

From Theorem 1.9, one can extract more information. Indeed, we have 

Dtv + (1/2) Au + fd^DiV - u + / - |/3| < 0 

in(5 = (—l,r)xZ) for any /3 G By considering large \f5\ we see that 
in the sense of generalized functions, we have ^DiV < 1 in Q for any unit 
^ G M'’*. 

It is known that if the generalized gradient with respect to x of a function 
that is measurable in (f, x) is bounded by 1, then the function itself coincides 
[(t,x)-a.e.] with a function whose Lipschitz constant with respect to x is 
majorated by 1. It follows that in Q (a.e.), the function v coincides with 
a function v that is Lipschitz continuous in x with the Lipschitz constant 
bounded by 1. 

We claim that v is itself Lipschitz continuous in x with the Lipschitz 
constant bounded by 1. To show this, take an e > 0 and define r“ as the first 
exit time of (t, wt + at) from = {—£, e) x Also, take a random variable 

^ which is uniformly distributed on [0,1] and independent of the filtration 
Then for any d > 0, 5^ is a stopping time with respect to the filtration 
{Bt V We also know that changing the probability space and filtrations 

does not affect the value function (see, e.g., [5, 6]). Set A {5Q. If 

(t,x) is such that {t,x) + Qe C Q, then for any control process 

a. For at = 0, by Theorem 1.9, 

(1.15) v{t, x) > Resv{t, x) + Sesv{t, x) + Pesf{t, x), 

where 

ReSvit, x) = E{e~^^v{t + (5^, X + W5^)Is^<r^}, 

Se5v{t,x) = E{e~'^^ v{t + , X + Wr^)Is^>T^}, 

/*T^ 

Pesf{t,x) = E / ''\~^f{x + Wt)dt. 

JO 

Obviously, as <5 J, 0, Sesv and Pesf tend to zero uniformly with respect to 
(t,x). Also, by the lower semicontinuity of v and Fatou’s lemma (|?;| is 
bounded), 

liminf R^sv{t, x) > v(t, x)P(0 < r“) = v(t, x), 

which, along with (1.15), shows that Resv ^ x as d | 0 on the set of {t, x) such 
that {t,x) + Qs C Q. We now observe the obvious fact that the distribution 
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of {6^,ws^) has a density, so that in the definition of Rssv, we can replace v 
with V, which implies that 

\Resv{t,x) -Re 5 v{t,y)\ <\x-y\ 

for all e > 0 and 5 > 0. This and the above prove our claim. 

Note that generally, since g is only assumed to be lower semicontinuous, 
it is easy to see that v need not be continuous in D. Also, v need not be 
continuous in t unless g is continuous in t. 

Example 1.12. In Example 1.11, the value function is most likely dis¬ 
continuous because the data are unbounded. However, Assumption 1.7 does 
not guarantee that v is continuous in QU&Q, even if everything is bounded 
and continuous. To see that, return to Example 1.4, letting (1.8) describe 
the dynamics for some control a £ A = {1,2} and the equation 

(1.16) dxt = dwt, dyt = dzt 

describe the process response under the other control /3, where {wt,zt) is a 
two-dimensional Wiener process. Also, let /" = /^ = 1 and keep g = 0. Then, 
obviously, v is greater than the function of the same name in Example 1.4. 
Also, v{0,x,y) = 0 for {x,y) G dB 2 and, thus, v{0,x,y) is discontinuous at 
the points (—\/3, ±1). However, as is easily checked the function 

Ht,x,y) = 2{2-r){r-l), r=\Jx'^ +y‘^, 

satisfies Assumption 1.7 with a = (3. 

Example 1.13. In Example 1.12, the function v is discontinuous only 
at a few points on the boundary. One can modify this example in such a way 
that Assumption 1.7 is still satisfied and the discontinuities occur inside Q. 
To show that, replace (1-16) with 

dxt = h{rt)xt dt, dyt = h{rt)yt dt, 

where b{r) is a smooth function on [1,2], with 6(r) = —1 for r £ [1,5/4] 
and b{r) = 1 for r G [7/4,2]. Then any smooth function ijj(t,x) such that 
ijj = r — 1 near dBi and ijj = 2 — r near dB 2 satisfies Assumption 1.7 near 
dBi U dB 2 . According to Remark 1.8, one can find a new function satisfying 
Assumption 1.7 as it is stated. 

However, it is not hard to see that the new value function v coincides with 
the function from Example 1.4 on the set where t = 0,r£ [1,5/4], x < 0 and 
y G [—1,0]. Since, on the other hand, v is not less than the function from 
Example 1.4, ^(0, x, y) is discontinuous on that part of the line (x, —1), x < 0, 
which lies in B ^/4 \ Hi. 
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Remark 1.14. Theorem 2.1 in Chapter V of [4] concerning Bellman’s 
principle requires the existence of a rather smooth function g va. Q such that 
g = g on (—1, T) x dD, g>g on {T} x D and in Q, 

(1.17) A 5 + sup[L"ff + /"] <0. 

oGA 

This assumption is not satisfied in Examples 1.4 and 1.12 where 5 = 0 
because otherwise, by Ito’s formula, we would have v <g in Q U d'Q and 
^(O,^,^) would go to zero as (x,y) goes to dD. 

2. Lipschitz continuity of n in a; and Holder continuity of v in t. In this 
section, we show that under certain additional conditions, the function v 
defined in Section 1 is Lipschitz continuous with respect to x and Holder 
1/2 continuous in t. Both the case that Q is a general domain and the case 
that Q is a cylindrical domain are treated. 

For some applications (see, e.g., the proof of Theorem 2.17), it is also 
convenient to investigate the dependence of v on parameters. Therefore, 
apart from our basic objects and assumptions introduced at the beginning 
of Section 1, we suppose that for an eo £ [0,1] and each s £ {0,eo}) we are 
also given 

(T"(e) = ^“(e) = b°{t,x,e), 

( 2 . 1 ) 

c“(e) = c"(t,x,e), /"(e) = /"(t,a:,e), g{e) = g{t,x,e), 

having the same meaning and satisfying the same assumptions as the original 
a,b,c,f. The solution of (1.1) corresponding to a°‘{e),b°‘{e) will be denoted 
by x"’b’^(e) and the functions u", v constructed from the new objects by 
u"(t, x, e) and v{t, x, e), respectively. We assume that for e = 0, the functions 
in ( 2 . 1 ) coincide with the original ones, so that in our notation, 

v°‘{t,x) = u"(t,x,0), v(t,x) = v{t,x,0). 

Naturally, the operator L" constructed from cj"(e), 6 "(e) and c°‘{e) is de¬ 
noted by L" (e), and by (e), we mean the first exit time of (t -|- s, (e)), 

s > 0, from Q. 

Let A £ [0,oo), K, Ki,T £ (0,oo) be constants. The names of the follow¬ 
ing assumptions contain a parameter e. This is done in order to provide 
flexibility for using the assumptions in different settings. 

Assumption 2.1 (e). (i) We have Q C (— oo,r) x and in Q, we are 

given a continuous function if; such that = 0 on the parabolic boundary 
d'Q of Q. 

(ii) The functions 5 (e) and i/, their first and second derivatives in x and 
first derivatives in t are a continuous on Q. 
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(iii) For each a £ A on Q, we have 

\ne) + Dtg{e)+L-{e)gis)\<Ku c“(e) > A. 

Assumption 2.2 (e). For any a £ A, it holds that 
Ai/)-L L“(e)V ’<-1 in Q. 

Assumption 2.3 (e). (i) For ({e) = a°‘{e),b°‘{e), a £ A and any 

{t, y) £ Q, we have 

\C{t,x,e) - C{t,y,0)\ <K{\x-y\+e). 

(ii) For ({e) = 'ilj, c“(e), g{e), /“(e), a£A and any {t,x),{t,y) e Q, we 
have 

\C{t,x,e) - Cit,y,0)\ <Ki{\x-y\+e), 
where |cr| has the usual meaning (trace for matrices a. 

We start by estimating the moments of the difference of solutions of (1.1) 
with different initial values. 


Theorem 2.4. Let Assumption 2.3(e) (i) be satisfied for some e £ {0,eo}. 
Take any p> 0, {t,x), {t,y) £ Q, a £ 21 and a stopping time 7 < A 
r“’*’^(e). Then 

(2.2) F;supe-^"|x“’‘’^ - x“’‘’^(e)|P < 3(|y - x\p + 

5<7 

where M = M(j>,K) > 0. 


Proof. First, we take p>2. For simplicity of notation, we drop the 
indices a,t,x,y in what follows. For instance, we denote Xr = 3 :“’^®. Also, 
set yr = x“’*’^(e). 

By using Ito’s formula, for s £ [ 0 , 7 ], we obtain 
e-^^i\xs-ys\^ + en 


x-yfi + eP + ms 
— Alf {\xr — yr\^ + £^)e~^'^ dr 

Jo 

+ p [ \xr - yr\^~'^{xr “ Vr)*{b{t + r, Xr) - b{t + r, yr, e))e~^'^ dr 


JO 


+ 


p{p - 2 ) 


/ \xr-yr\^ ^\o'it + r,Xr) - cr{t + r,yr,£) 


pe-^Mr, 


2 


0 



14 


H. DONG AND N. V. KRYLOV 


where mg is a local martingale starting at zero. Due to Assumption 2.3(e)(i), 
we can choose M = M{p, K) > 1 sufficiently large so that 

e~^%\xs - ys\P + eP) <\x- y\P + eP + mg. 

Upon applying Lemma 7.3(i) of [9], we get 

Ee-^Wx^ - y^\P + eP) <\x - y\P + eU 

Since 7 is any stopping time < by Lemma 7.3(ii) of [9], we 

conclude that 

E^vipe-^^^\xg - ygf < Esnpe-’^^^ {\xg - yg\P + ePf 

5<7 S<'y 

•/I''+£'■)" 

1—0 

<^{\x-yf + eP^) 

for any <5 G (0,1/2). It only remains to observe that when p runs through 
[ 2 , 00 ) and 5 through ( 0 , 1 / 2 ), the product p6 covers (0,oo). □ 

By using (1.11), we arrive at the following: 

Lemma 2.5. Let Assumptions 2.1(e) and 2.2(e) be satisfied for some 
e G {0, eo}. Then on QU d'Q, we have 

\v{t,x,£) -g{t,x,£)\ < Ki'ip{t,x). 

Theorem 2.6. Let Assumptions 2.1(0) and 2.2(0) be satisfied. Take 
some e G {0,eo} and suppose that Assumptions 2.1(e), 2.2(e) and 2.3(e) are 
satisfied. Then there are constants N depending only on K, Ki,di,d and M 
depending only on K such that for any {t,x), {t,y) G Q U d'Q, we have 

(2.3) \vit,x) - v{t,y,£)\ < -y\+ e). 

Proof. Due to Lemma 2.5, we may concentrate on points inside Q. Fix 
{t, x), {t, y) G Q and for any a G 21 and s > 0, set 



This notation will allow us to use our convention regarding indices with 
which we provide the expectation sign. 

By using Theorem 1.6 with 
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we get 

(2.4) \v{t,x)-v{t,y,e)\<h+l 2 , 


where 

h = supE° [ ++s,ys,e)e~'^‘\ds, 

oea Jo 

h = svLY)E^^\v{t + ^,x^)e~‘'‘^'< - v(t + 'y,y^,e)e~‘^'^\. 
aea 

By using the inequality |e“ — e^| < e“^^|a — b\ and Assumption 2.3, we 
obtain 


\f'^‘{t + s,Xs)e + s,ys,e)e 

<Ne~^^ |x<i-y<i|+e+ [ {\xr - yr\ + s) dr 

Jo 

< \e->^^{\xs - ys\ + e) + T e->^^{\xr 

Jo 


<Ne^^^-^>{l + s)supe-^^%\xs-ys\+e) 

5<7 

< supe“'^"(|a:, - i/sl + e), 

5<7 


yr\ +s)dr 


where y is any constant > 0. Upon applying Theorem 2.4, we get 

/i < A^supU"^, supe“^^(|xs — ys|-L e) f ds 

a&. ’ s<7 Jo 

(2.5) 

<N{\x-y\+ 

To estimate I 2 , we observe that either (t-|- 7 ,x.y) or (t-|- 7 ,y.y) is on d'Q. 
Due to Lemma 2.5, in the first case, we have 

\v{t + 7, x^)e~'^'^ - v{t + 7, y^, e)e“‘^T' | 

= Igit + 7, Xry)e~'^'-< - v{t + 7, y^, e)e“‘^^ | 

< \g(t + j,x^)e~^'^ - g(t + j,y^,£)e~^'^\+ N\i/j{t + j,y^)\e~'^^ 

( 2 . 6 ) 

< jYg(M+i-A)7supe-^7|x, -y,| +7 

5<7 

+ N\il;{t + J,x^) -Ip{t + J,y^)\e~'^^ 

< Are(^+^-^)T'supe-^7|x, - y.| + e). 
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A similar argument is valid in the second case. Thus, by Theorem 2.4, for 
any a G 21, we have 


(2.7) 


< A^(|x - y| + 


After combining (2.4), (2.5) and (2.7), we obtain (2.3) with M + 2 in place 
of M. □ 


Theorem 2.7. Under Assumptions 2.1(0), 2.2(0) and 2.3(0) also sup¬ 
pose that for any a € A in Q, 

(2.8) k“| + |6“| <771. 

Then there are constants N = N{K,Ki,d,di) and M = M{K) such that for 
any {t, x), (s, x) G QU d'Q such that |s — t| < 1, we have 

(2.9) |u(s,x) -v{t,x)\ < \g{s,x) -g{t,x)\ +Ki\'tp{s,x) -'0(t,x)| 

+ Ar|5_i|i/VT-0(M-A)+_ 

In particular, if g and if are Hdlder-1/2 continuous in QUd'Q with respect 
to t, then so is v. 


Proof. Observe that if both points (s,a:) and {t,x) are on d'Q, then 
the left-hand side of (2.9) is less than the first term on the right and so there 
is nothing to prove. However, if one of them is in Q, then x can be slightly 
moved in such a way that they both fall into Q and by Theorem 2.6, this 
leads to an insignificant modification of the left-hand side of (2.9). We see 
that it suffices to concentrate on (s,x), (t,x) G Q. 

Next, we assume that t < s and set = (^s — t) A Note that by 

Bellman’s principle and Ito’s formula (as usual, we drop indices a,t,x from 
objects behind the expectation sign), 


{v- g + Kiil;){t,x) 


where 


aest 


{v 


g + Kiif)(t-\--f,x-f)e 


+ + Ki{Dt + L^Qif){t + r,xr)e-^'' dr 

Jo 


/“=/« +(A+l“) 5, iri<i7i, r+i7i(A+^“)V’<o. 

Since v — g + Kiif = 0 on d'Q, 

Et,x{v -g + -L 7, -g + Kiif){s, Xs-t)e~'^‘‘~'I-i=s-t, 
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so that by Theorem 2.6, 

Et,x(.v -g + + 7, 

< E^J{v -g + x) + iVe(^-*)(^-^)+ |x - 

Furthermore, well-known estimates of stochastic integrals, combined with 
the assumption that a and b are bounded and that s — t < y/s — t, imply 
that 


“ Ts_i| < Ny/s — t. 

Next, according to Lemma 2.5, we have {v — g + KiTp){s,x) > 0. It follows 
that 

{v — g + Ki'ij;){t,x) < {v — g + Ki'ij;){s,x) + y/s — t, 

v{t,x) - v(s,x) < lg(t,x) -g(s,x)l 

+ iLi|V’(t,T) — -0(5 ,t)| -|- y/s — t. 

That 


v{t,x) -v(s,x) > -lg(t,x) - g(s,x)l 

— Kil'i/j(t,x) — V’(s,t)| — N y/s — t 

is proved similarly by considering v — g — Kiip and noting that this function 
is negative on Q. The theorem is thus proved. □ 


Next, we consider the case where 

Q = {-l,T)xD 

is a cylindrical domain in under weaker assumptions on the boundary 
data. Let L> be a bounded domain and let 'tp{t,x), 51(e) = gi{t,x,£) and 
52(e) =52(x,e) be functions on Q. 

Assumption 2.8 (e). (i) The functions 51(e) and i/;, their first deriva¬ 

tives with respect to (t, x) and their second derivatives with respect to x are 
continuous on Q, 'tp > 0 in Q and ip vanishes on (— 1 ,T) x dD. 

(ii) We have 

5'(£)=5i(e) on (-l,r) X aD, 

^(e) =5'2(e), |52(e)|<A:i, 152(e) - 51(e)| < AiV^ on {T} x L». 

(iii) For each a £ A on Q, we have 

ir (e) + A 5 i(e) + L'^ie)gii£)\ < c“(e) > A. 
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Observe that 


d'Q = {{-l,T) X 9D)U({r} X D). 

Ito’s formula immediately yields the following: 

Lemma 2.9. Let Assumptions 2.8(e) and 2.2(e) be satisfied for some 
e G {0, eo}. Then on QU d'Q, we have 

(2.10) \v{e) - gi{e)\ < Kifi. 

The following theorem can be proven in almost the same way as Theo¬ 
rem 2.6. By “the assertion of Theorem 2.6” in Theorem 2.10 we mean that 
which follows “Then” in the statement of Theorem 2.6. Theorem 2.13 should 
be read similarly. 

Theorem 2.10. Let Assumptions 2.8(0) and 2.2(0) be satisfied. Take 
some e G {0,eo} and suppose that Assumptions 2.8(e), 2.2(e) and 2.3(e) are 
satisfied if in Assumption 2.3(e), we replace g with gi,g 2 - Then the assertion 
of Theorem 2.6 again holds true. 

Indeed, we can reproduce the proof of Theorem 2.6 except that we use 
Theorem 1.9 in place of Theorem 1.6 and while estimating L 2 instead of (2.6), 
we write 


\v{t + 7, x^)e~'^'' - v{t + 7, e)e“‘^'^ | 

= • • • + • • • I'y=T-t 

= bi {t +1, Xj)e~‘^^ -v(t + j,y.y, 

-L \g2{xT-t)er'^'^-^ - g2{yT-t,e)e~'^'^~"\I^=T-t, 

where as before, the hrst term on the right is less than the last term in (2.6) 
and the second is maj orated by I.y=T-t times 

Ki{\xT-t-yT-t\+£)e~^^^~^^ + f {\xr - yfi + e) dr. 

Jo 

Remark 2.11. In Theorem 2.10, we required if to satisfy Assump¬ 
tion 2.2 in Q. As in Remark 1.8, one may show that we actually need this 
assumption only near (—l,r) x dD. 

Using Theorem 7.4 of [7] (or the corresponding results in [5]) and the 
above results immediately yield the following; 
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Corollary 2.12. Suppose that the assumptions of Theorem 2.10 or 
Theorem 2.6 are satisfied with e = 0. Then for any a ^ A, (1.7) holds true 
in Q in the sense of generalized functions, that is, for any nonnegative x S 




Q 



Our next result concerns the Holder continuity of u in t. 

Theorem 2.13. Under Assumptions 2.8(0), 2.2(0) and 2.3(0), suppose 
that (2.8) holds for any a ^ A in Q. Then the assertions of Theorem 2.7 
are valid with gi in place of g in (2.9) and v is Hdlder-1/2 continuous in 
Q U d'Q with respect to t. 

The proof of this theorem follows that of Theorem 2.7 almost word for 
word; of course, we replace g with gi in that proof. 

In the following remark, we state an analog of one of the assertions of 
Theorem 2.1 in Chapter V of [4]. As everywhere in the article, we remain 
within the framework introduced in Section 1. 

Remark 2.14. Let Q = {—1,T) x D and let tp he a function on Q which 
is continuous along with its first derivatives with respect to {t,x) and the 
second derivatives with respect to x. Also, let Assumption 2.2(0) be satished, 
let V' > 0 in Q and let V' = 0 on (—1, T) x dD. Assume that A = A(l) and g 
is continuous. It then turns out that v is continuous in(5\({ —l}xZ)). 

Indeed, the fact that A = A{1) guarantees the validity of (2.8) and As¬ 
sumption 2.3(0)(i). Furthermore, having in mind approximations using mol- 
lifiers, we may assume that c and / are Lipschitz continuous in x uniformly 
with respect to other variables and that g is infinitely differentiable (see 
more about this in [5]). Then it only remains to observe that v is continuous 
in Q \ ({—1} X D) by Theorems 2.10 and 2.13 [of course, in these theorems, 
we take gi{e) = g{e) =g and 52(e) =g{T,-)]. 

Note that our requirement that Assumption 2.2 be satisfied is, in fact, 
very similar to condition (1.17) imposed in Theorem 2.1 in Chapter V of [4]. 
However, we only need it for g^h, albeit with 1 in place of /“. 


Before stating out last result, the obtaining of which largely motivated 
this article, we take a d G (0,1], define R = {x G : |x| < 1}, A = (—1,0), 


A = A X A X B, 
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for (5 = {a, r, y) G A, set 

= (o-“,6",c",/“)(t + 5V,x + (5y), 

and introduce the following: 

Assumption 2.15. (i) Assumptions 2.8(0), 2.2(0) and 2.3(0) hold if we 

there replace A, cj“, 6", c",/“ with A,a^,b^,c^, , respectively. 

(ii) For each a G A in (—2,T) x the functions (t“ and 6“ are Lips- 
chitz continuous in x with constant K and Holder-1/2 continuous in t with 
constant K, and the functions c" > A and /“ are Lipschitz continuous in x 
with constant Ki and Holder-1/2 continuous in t with constant Ki. Condi¬ 
tion (2.8) is also satisfied in that domain. 

(hi) The functions 'ip and gi are defined on H := [0,T] x and are Lips¬ 
chitz continuous in x with constant Ki and Holder-1/2 continuous in t with 
constant Ki. 

Remark 2.16. On account of Assumption 2.15(ii) and the boundedness 
of the derivatives of and gi entering the operators obviously, Assump¬ 
tion 2.15(i) is satished for sufficiently small 6 and somewhat modified and 
Ki if Assumptions 2.8(0), 2.2(0) and 2.3(0) hold in their original form. 

Recall that until now, continuity in t has not been assumed for a,b,c,f. 

Introduce 

H{6) = [0,T-6^] X 

D^ = {x£D: dist(x, dD) > 5}, Q{6) = (0, T - 6^) x D^. 

For multi-indices 7 = (71 ,... , 7 ^), 7 * = 0,1,..., as usual, we set 
D2 = D^A---DJA |7l=7i + --- + 7d- 


Theorem 2.17. Extend v as gi in H\Q. Suppose that Q{6) A Then 
under Assumption 2.15, there exists an infinitely differentiable function 
defined on H{6) such that for any a G A, 

( 2 . 11 ) Am ‘^ + lV + /“<0 

in Q{6) and for any integers m > l,k,l > 0 and multi-indices 7 such that 
2k-\-l = m and I7I = I, 

( 2 . 12 ) \D^D2u\t,x)\<Ne^^-*'>^^-^^+6^-^, 

(2.13) \u^{t,x)-v{t,x)\ 

in H{5), where N = N{K, Ki,d, di) and M = M{K). 
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Proof. Let be constructed from A,a^,b^,c^,f^,g in the same way 
as V from A, Extend as <71 in H\Q. Note that by virtue 

of Assumption 2.15 and Theorem 2.10 (where we take e = Eq = ^)) we have 

(2.14) \v{t,x) - v^{t,x)\ < iVe('r-d(A^-A)+^ 

in (—l,r] X R'^. Furthermore, by Assumption 2.15 and Theorems 2.10 and 
2.13, 

(2.15) |/(t, x) - v^s, y)\ < (|t - + |x - y\) 

if {t, x), {s, y) G (—1, T] X R'^ and |t — s| < 1. 

Take a nonnegative function C, G C'^(R'^"’“^) with support in A x and 
unit integral. Our goal is to prove that 

u\t,x):=6~'^~‘^ [ v^{s,y)C{S~‘^it-s),6~^{x-y))dsdy 

JRd+l 


is a function we need. 

Inequality (2.12) follows from (2.15) and elementary properties of molli- 
fiers which also imply that 

\u\t,x)-v\t,x)\ <Are(^-‘)(^-^)+,5 


in H{5). By recalling (2.14), we see that it only remains to prove (2.11). 

By Corollary 2.12, for any nonnegative y G C^{Q), 

I {t,x){—Dt — c°‘{t + 5‘^r,x + 5y))x{t,x) dtdx 
JQ 

+ [ [x{t,x){{b°‘y{t + d‘^r,x + 6y)Div\t,x) 

JQ 

-L/“(t-L(5V,x-L(5y)) 

- {x{t,x)Di{a^Y^{t + 5^r,x + 5y) 

+ + 5^r,x + Sy)Dix{t,x))DjV^{t,x)\ dtdx < 0. 

We here substitute x{t + x + 5y) in place of x(f, x) and change variables 
{t + 5‘^r,x + 6y) —> {t,x) to find that for any fixed r G (—1,0), \y\ < 1 and 
nonnegative y G C^{Q{6)), 



v^{t — 5^r,x — 6y){—Dt — c")x(L®) dtdx 

+ / [xib‘^y{t,x)Div\t - 6^r,x - 5y) + xf’^it^x) 
Jq{5) 


-{xDya^r + {a^yWa){t,x) 

X DjV^{t — 5^r,x — 5y)] dtdx < 0. 


(2.16) 
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After multiplying (2.16) by Q{r,y)^ integrating with respect to (r,y) and 
using Fubini’s theorem, we obtain 

[ u^{—Dt — c°‘)xdtdx 
jQi5) 

(2.17) +/ [x{b^yDiU^ + xr-{xD^{a'^^ + {ayWix)DJU^]dtdx 

Jq(s) 

< 0 . 


Since is smooth and x £ C^{Q{d)) is an arbitrary nonnegative function, 
after one more integration by parts, inequality (2.17) implies (2.11). 

The theorem is thus proved. □ 
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